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THE ISO/CCITT STANDARD FOR CONTINUOUS-TONE IMAGE 

COMPRESSION 

Gregory K. Wallace 

Digital Equipment Corporation 

Littleton, MA 01460 

ABSTRACT 

The Joint Photographic Experts Group is an ISO/ 
CCITT working group in the process of developing an 
international standard for general-purpose, continoustone, 
still-image compression. A brief history is presented 
as background to a summary of the past year's 
progress, which was highlighted by definition of the 
overall structure of the proposed standard. This structure 
consists of a Baseline System, a simple coding 
method sufficient for many applications, a set of Extended 
System capabilities, which extend the Baseline 
System to satisfy a broader range of applications, 
and an Independent Lossless method for applications 
needing that type of compression only. 
1. INTRODUCTION 

The Joint Photographic Experts Group (JPEG) is 
a working group of technical experts in image coding. 
The goal of JPEG is to develop an international standard 
for compression of still-frame, continuous-tone 
(gray-scale or color) images. The aim of the standard 
algorithm is to be general-purpose in scope, i.e., to 
support as wide a variety of image communication 
services and image-based computer applications as is 
feasible for a single standard. 

JPEG reports jointly to both the ISO group responsible 

for Coded Representation of Picture and 

Audio Information (ISO/IEC JTC1/SC2AVG8) and 

to the CCITT Special Rapporteur group for Common 

Components for Image Communication (a subgroup 

of CCITT SGVIII). This dual reporting structure 

is intended to ensure that ISO and CCITT produce 

compatible image compression standards. 

This paper is a progress report on the JPEG standardization 

effort, and is intended as an update to the 

set of papers presented here last year [1-3]. Note: 

the structure of the algorithm and its various modes 

of operation as described in this paper must be regarded 

as work in progress toward a draft standard. 

The material presented here reflects the committee's 

consensus up through the July 1989 meeting, but this 

material is subject to change during the remainder of 



duced the best picture quality. Since then, a group- 
wide effort to refine, test, and document the DCT- 
based algorithm, in a)] of its modes of operation, has 
been underway. The background summarized in this 
section is described in much greater detail in [1-3]. 

3. ALGORITHM STRUCTURE OVERVIEW 

The proposed JPEG algorithm structure is com- 
prised of three main parts: (1) a Baseline System, (2) 
a set of optional Extended System capabilities, and 
(3) an Independent Lossless coding capability. 

Baseline System is the name given to the simplest 
image coding/decoding capability proposed for the 
JPEG standard. It consists of techniques well-known 
to the Image Coding community, including 8x8 DCT, 
uniform quantization, and Huffman coding. Together 
these provide a non-lossless, high-compression image 
coding capability, which preserves image fidelity at 
compression rates competitive with or superior to 
any techniques, regardless of their complexity, known 
to JPEG committee members. The Baseline System 
provides "sequential build-up" only, which means that 
an encoded image is transmitted as a single pass, and 
pixels are reconstructed at the decoder in essentially 
raster-scan order. 

Extended System is the name given to a set of 
additional capabilities not provided by the Baseline 
System. These optional capabilities may be imple- 
mented singly or in combination. Included among 
these are Arithmetic coding, "progressive build-up," 
and "progressive lossless" coding. 

Arithmetic coding is an optional, "modern" al- 
ternative to Huffman coding. Because the Arithmetic 
coding method chosen adapts to image statistics as it 
encodes, it generally provides 5-10% better compres- 
sion than the Huffman method chosen by JPEG. This 
benefit is balanced by some increase in complexity 
(though some experts debate this, depending on the 
definition of complexity), and the relative newness 
of the technique means that fewer parties worldwide 
have experience with practical implementations. 

Progressive build-up, the alternative to sequen- 
tial build-up, is a way of re-ordering the coded data 
prior to transmission, so that a rough approximation 
of the image will appear at the receiver first, followed 
by successively more detailed versions of the final im- 
age. This mode is useful for human interaction with 
picture databases over low-bandwidth channels. 

Progressive lossless refers to a lossless (also called 
"reversible" or "exact") compression method which 
operates in conjunction with progressive build-up. In 



this mode of operation, the final stage of progressive 
build-up results in a received image which is bit-for- 
bit identical to the original. 

This proposed algorithm structure also includes 
the requirement that the Baseline System be con- 
tained within every JPEG-standard codec which uti- 
lizes any of the Extended System capabilities. In this 
way, the Baseline System can serve as a default com- 
munications mode for services which allow encoders 
and decoders to negotiate. In such cases, image com- 
municability between any JPEG sender and receiver 
which are not equipped with a common set of Ex- 
tended System capabilities is assured. Redundancy 
of implementation is low, because any codec which in- 
corporates an Extended System capability needs all 
(or almost all) of the Baseline System components as 
a functional subset. 

The third part of the proposed algorithm struc- 
ture is the Independent Lossless coding capability, a 
simple, DPCM-based, stand-alone method of lossless 
compression. An Independent Lossless codec is not 
compatible with Baseline or Extended Systems, in 
the sense of having data interchange capability with 
either. (It does, however, use part of the same al- 
gorithm used in the Extended System's progressive 
buildup capability). 

The Independent Lossless capability has been pro- 
posed by JPEG, in addition to the Extended System's 
progressive lossless option, for the following reasons. 
Progressive lossless operates as a final pass added on 
to one or more DCT- based, non- lossless progressive 
passes. The DCT, plus the required buffers and con- 
trol logic needed in a progressive lossless implemen- 
tation, are relatively complex in comparison with the 
DPCM-based Independent Lossless algorithm. Ap- 
plications which require lossless coding only, with no 
need for any non-lossless capability, are likely to find 
the progressive lossless method burdensome. 

4. BASELINE SYSTEM 

The Baseline System provides non-lossless com- 
pression with sequential build-up. It can accommo- 
date pixels with 8 bits/color-component or less, with 
the Extended System handling higher precision pix- 
els. 

It operates by dividing an image into 8x8 pixel 
blocks, and transforming each by the 8x8 DCT to 
produce 64 output numbers or "coefficients." Each 
coefficient is then independently quantized by a uni- 
form quantizer with step-size determined by a cor- 
responding "visibility threshold" from a 64-element 
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quantization matrix. Of these 64 quantized values, 
the zero-frequency or "DC" coefficient is encoded dif- 
ferentially from the previous block's DC term. The 
63 "AC 1 coefficients are not differentially encoded. 
The quantized coefficients are then Huffman encoded 
to reduce statistical redundancy. 

The Baseline System specifies default Huffman ta- 
bles and quantization matrices, the latter based on 
CCIR-601 color images, a digital TV standard which 
uses a variant of the YUV color space [4]. There are 
two default matrices, one for Y and one for both U 
and V. There are two sets of default Huffman tables, 
with one DC and one AC table per set. 

Baseline System decoders are required to store 
the default tables and matrices, because when used, 
they are not transmitted as part of the coded data 
stream. Because the encoder may opt to use custom 
tables or matrices instead, in which case these are 
transmitted as part of the coded data stream, Base- 
line System decoders must also be able to receive and 
utilize whatever is transmitted. 

From these decoder requirements, it follows that 
a Baseline System encoder may operate in any of the 
following modes: (l) one-pass encoding, using default 
Huffman tables, (2) one-pass encoding, using custom 
Huffman tables pre-defined for some class of images, 
or (3) two-pass encoding, with the encoder creating, 
during the first pass, custom Huffman tables specific 
to the image being encoded. 

Though the default matrices and tables suggest a 
certain class of images, the Baseline System is a gen- 
eral purpose algorithm, able to encode images in any 
color space and with any pixel dimensions. (At press 
time, the possibility of eliminating default quantiza- 
tion matrices was under consideration within JPEG). 
Images represented in color spaces like YUV, which 
separate the chromatic from the achromatic informa- 
tion, generally will compress better than those like 
RGB, which do not, but the JPEG algorithm can be 
applied to either class of color space. 

A Baseline System encoder may optionally in- 
sert various types of "marker" codes within the en- 
coded image, with placements restricted to 8x8 block 
boundaries. One type of marker code is provided for 
resynchronization purposes, for uses such as partial 
protection against transmission or storage bit errors. 
These codes are uniquely identifiable without syn- 
chronization to the Huffman data stream. Because 
any encoder may opt to insert these codes, and be- 
cause DC-term encoding is reset for blocks following 
these codes, every Baseline System decoder must be 
designed to detect them and reset its DC decoding 



process accordingly. 

5. EXTENDED SYSTEM CAPABILITIES 

An Extended System includes all of the Baseline 
System, and then adds to it one or more of the capa- 
bilities described in this section. 

Additionally, as for the Baseline System, resyn- 
chronization markers may be used in conjunction with 
any of the Extended System capabilities. These codes 
are the same for both Arithmetic and Huffman cod- 
ing. Also, pixels of greater than 8 bits precision per 
color-component may be used with any of the Ex- 
tended System capabilities. 

5.1 Entropy Coding Options 

"Entropy coding" is the functional component of 
the compression system which compacts the data by 
reducing statistical redundancy. Either Arithmetic or 
Huffman coding may be used as the entropy coding 
method for a JPEG Extended System implementa- 
tion. Both coding methods have been designed by 
the committee so that transcoding from one to the 
other may be implemented straightforwardly. 

A. Arithmetic Coding 

Arithmetic coding investigations in recent years 
have resulted in a class of practical entropy coding 
algorithms which are relatively new with respect to 
the long-established Huffman coding techniques. Any 
of the Extended System capabilities described below 
may be used in conjunction with either Arithmetic 
or Huffman coding. Also, an Extended System codec 
may be formed by using the Baseline System compo- 
nents, but with Arithmetic coding used rather than 
Huffman. An excellent collection of papers on recent 
Arithmetic coding developments is contained in [5j. 

B. Extended Huffman Coding 

Huffman coding used in conjunction with any of 
the Extended System capabilities described below is 
referred to as "Extended" Huffman coding, to distin- 
guish it from the specific set of Huffman codes used 
in the Baseline System. However, the Baseline Huff- 
man codes form a subset of the Extended Huffman 
codes, which are only slight larger than the subset. 

5.2 Progressive Build-up 

The operation of an Extended System with pro- 
gressive build-up is in many ways similar to that of 
a Baseline System. The difference begins after quan- 
tization of the DCT coefficients, at which point the 
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quantized coefficients are stored in an image buffer, 
rather than being entropy encoded and transmitted 
immediately. After initial quantization and storage, 
the encoder makes two or more passes through the 
image, encoding only a portion of each 8x8 block's 
quantized coefficient data during each pass. 

The following features are non-overlapping char- 
acteristics of progressive build-up, which may be used 
together or in combination. (At press time, JPEG 
was still considering whether to require that progres- 
sive build-up decoders be able to handle all these fea- 
tures). 

A. Successive Approximation 

This method encodes increasingly-refined image 
detail, by encoding (potentially) all DCT coefficients 
within each 8x8 block to successively greater accu- 
racy during each pass of the build-up. 

B. Spectral Selection 

This method encodes increasingly-refined image 
detail, by encoding different groups of DCT coeffi- 
cients with each 8x8 block during each pass of the 
build-up. Spectral selection and successive approx- 
imation are quite complementary modes of progres- 
sive build-up, and for many applications may be ef- 
fectively used in conjunction with one another. 

C. AC Prediction 

This technique predicts low-frequency AC terms 
from nine (quantized) DC terms: the one from the 
current block plus the eight surrounding blocks. This 
method results in improved quality, particularly of 
low bit-rate stages during the progressive buildup. 

D. 2-D DC Prediction 

With two-dimensional (2-D) DC prediction, the 
previous block's DC term, plus the DC term of the 
block above, are used to formulate the prediction of 
the current DC value to be differentially encoded. 
This results in a "lossless" encoding of the quantized 
DC terms. This lossless 2D predictor is also used for 
Independent Lossless coding. 

5.3 Progressive Lossless 

This feature provides reversible compression by 
sending a difference image, the per-pixel difference 
between the non- reversible and the original images, 
as a final "stage" of encoded data. This feature re- 
quires that the encoder contain an inverse DCT and 
an inverse quantizer. JPEG may revise this method 
to a "near- lossless" capability, because unless JPEG 



specifies that the inverse DCT implementations in 
both the transmitter and receiver must be identical, 
pixels in the reconstructed image will occasionally 
differ from the original by one pixel level. This is 
a result of inevitable rounding differences resulting 
from the finite arithmetic of non-identical implemen- 
tations. At press time, this matter was still under 
consideration by JPEG. 

5.4 Hierarchical Progressive Build-up 

This feature provides a hierarchical encoding of 
an image, obtained via the following procedure: (1) 
filter and down-sample the original image by a factor 
of 2 N in both dimensions, (2) encode this reduced- 
size image either sequentially or progressively by the 
methods already discussed, (3) use this reduced-size 
image as a predction for the next (2 N " X ) stage, (4) 
encode the 2^"* difference image. This procedure is 
repeated until the final stage is reached. This capa- 
bility is useful in applications where it is desirable to 
access a significantly reduced size version of a large 
image. This method is illustrated schematically in 
[2]- 



6. INDEPENDENT LOSSLESS CODING 

Independent Lossless coding is a simple, DPCM- 
based, stand-alone method of lossless compression, 
provided to meet the needs of applications which loss- 
less coding only, with no need whatsoever for much 
higher compression non-lossless, DCT-based meth- 
ods. The algorithm is comprised of the 2-D DC pre- 
dictor described above as part of the progressive build- 
up algorithm, but here it operates directly on pixels 
rather than DC coefficients. The difference between 
the prediction and the actual value is encoded ioss- 
lessly by either Huffman or Arithmetic coding. 

7. STANDARDIZATION SCHEDULE 

This paper described the proposed structure of 
the JPEG standard, a major accomplishment of the 
past year's work. Several revisions of the detailed 
technical specification were also created in the past 
year. JPEG expects to finalize the remaining techni- 
cal issues at its October 1989 meeting, and to release 
a draft technical specification of the algorithm to ex- 
ternal coding experts before the end of 1989. An ISO 
Draft Proposal should be approved at the February 
1990 meeting, with ISO balloting to begin in March. 
The final standard should be approved by early 1991. 
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